BEST AVAILABLE COPY 

01-17-06 01:45pm . Frcra-KATTEN MUCHIN ROSENMAN 13129021061 3129021061 



T-573 P. 01/09 F-220 



KATTBN MUCHIN ROSENMAN LLP 



52S lypjf Monroe Spear 
CMCBQO. IL 60067-5693 
372.902.5200 dfeo 37S9Q21Q6J for 



FacslmileTa Company. ... \.Fto.Humt»r. Phone Number 



Mail Stop Appeal Briefs USPTO 
- Patents - 
Commissioner for 
Patents 



(571) 273-8300 



RECEIVED 
Central fax center 

12. 



Date 


OlenVMatter Number 




January 17, 2006 


213187-00002 




From 


Attorney Number 




John S. Paniaguas 


32347 




Phone 


Fax 




312.902-5312 


312.577.4S32 




Total numow of pages, including ewer letter; pages /Ji r\/> n PA 
ffyou do not receive all of the pages, please call; 312,902.5312 f U£\J^^Q_ 



Comments 

RE- i^entATjplkanonNo.: 09/679,391 
filing Date: October 3, 2000 
Inventor: Bates, c?ai- 

Tide: Method and Apparatus for Associating the Color of m Object with aa Event 
Confirmation No.: 6681 

Please file the awacbed: 
Transmittal Form Op.) 

Reply to Examiner's Answer of November 16, 2005 (7 pp,) 



Certificate of Transmission 

I hereby certify that this correspondence is being facsimile transmitted to the U.S, Patent and Trademark Office 
((571) 273-8300) . 



(Typed or printed n^e o f^ g ^sj^ng ^^ certificatf) 




For Messenger Department Use Only 

Your fax has eeen sent Attached is your ori&nat 



Tone 



Signature 



Important 



ThfS fac&mtie transmission conmns information mianaea rpr wo 
tuchtfive us* of me inphttoiM or entity to wnom a *s agaressea ana may 
contato information zftar is proprietary, prnnlegets, conGoentfaf an&or 
exempt from OiBctasura umter appbeaote law 

it you me twine tnienoed re&ptem (or an em&oyee or agenj 
responskae tordeikorfng irus fac&mte transmis&on to me <nt*n0oa 
rec&entl yem are hereby notified Wat any cqpyino. amcio&vr*of 
ti&MH&an of Wis oifbumrofl way Ge swf&ccr to tegty rexncVon or 
sanction. W&iss nouiy the senaer oy telephone to arrange for me return 
or eftsr/weftoft of tne information ana an eop&9 



Crtfcago New York Us Angelas WMfrngton. PC Crwwto PmAno Newark rww-tonzrcom 

A Law Partnerxntp nci^ng Professional Corporation* 
Dw*.CHJ£>l (2W187-WX)O2>5OJ3U54rl < 01/17/2006rri n iB.?3 04 



PAGE 1/9 • RCVD AT 1/17/2006 2:41:17 PM [Eastern Standard Time] ' SVR:USPTO-EFXRF-6/31 1 DNIS:2738300 * CS1D:3129021061 * DURATION (mm-ss):03-02 



01-17-06 01:45pm • From-KATTEN MUCHIN RQSENMAN 131 29021 Q61 



3129021061 



T-573 P- 02/09 F-220 



y^mnP,^ Reduction fln nnfflfi rtO I 



PTO/SB/21 

Approved for w*e mrough 07/31/20QS OMB 0651-0031 
U.S. Pwem and Trodemani Office; U.S. DEPARTMENT of COMMERCE 



TRANSMITTAL 
FORM 

f rp oo u»»8tf far aff corrssponckinGo otter moat togj 



Total p <" m&ef of Pas 85 «" Tfy* Supmb8l0n 



Application Number 



09/679.331 



Films Date 



Oaopar 3, 2000 



pjrst Named inventor 



Sates. e?at- 



BECE1VCD 



Art unit 



2576 



ft PNTRAL FAX CENTER 



Examiner Name 



JAN 1 7 2006 



Attorney 0ock«t Number 



213187^00002 



ENCLOSURES {Check sumaxsppfy) 



□ 



□ 
□ 

□ 

□ 

□ 



Fee Transmittal Form 
O Fee Attached 

Amendmeni/Repfy 
□ After Final 

□ 

Exiensjon of Time Reqvesr 
Express A&anoonmeni Request 
information Disclosure Statement 



Cer&fied Copy of Pnonty 
Document(s) 

8ep|y to Missing Parts/ 
incomplete Appfccat>on 

Reply to Mining Parts 
under 37 CFR1-S2 on.53 



[Zj UceflSing-reiated Papers 

□ 
□ 
□ 
□ 
□ 
□ 



Petition 

Petition to Convert to a 
Provisional Application 
Power of Anomey, Revocation 
C tonga of Conaspondence Address 

Terminal Disclaimer 
Request for Refund 
cp, Numper of CP(s> 



□ 



landscape Taote on CP 



□ 
□ 

□ 
□ 
□ 



After ABowance Comrnwrwatton » TC 

Appeal Communication id Board 
of Appeals and interferences 

Appeal Communication to TC 
(Appeal NotfPft. Prter, Kept y Brief) 

Proprietary information 

Status Letter 

omer EndosMfeCs) (p)ease wentrfy 
below): 



SIGNATURE OF APPLICANT, ATTORNEY, OR AGENT 




CERTIFICATE OF TRANSMISSION/MAILING 



I nerepy certify mat m correspondence is toeing facsimile transmitted to the uSPTO or deposited wnn me umtea States postal Service wim 
sufficient postage as first cjass mail in an envelope addressed to; Commissioner for Patents, P O Box 1450. Alexandria, va 22313-1450 on 
tne oate snown below 




This cotton of .nfomKKton # ^qwred by 37 CFR l ,& Toe .ntormation * requ#«i to mm or n&w a oenefn &y me pupitc wpipn * ?o ft* (and Py me uSPTO id 
prpoa*) *<i apptic^on CwftenaaMv * governed t* 33 u,S-C 122 ana 37 CFRj.ii tfffl.H. Tn.s cojiac*on * t^m*iaoiD2 ^^o^^^S 
fiatnenng. pnspgpns, and a**m*wis me comptetad application form to me uSPTO T«rr» win vary depend** «P°n me individual ca*^My comrneros on me 
amount of time you require p compter* in* farm and/or aagesum* for rsouong tnts Burden. eriQMKJ tw smrt to mo Cniet information Officer, u S Pawtwid 
T^^ taMfiO. Alexandra VA 223^1450 PO NOT SEKD FEES OR COMPLETED FORMS TO THIS 

ADDRESS SEHPTO: Commissioner for Parents, P-O- Box 1450, Alexandria, VA 22313-1430. 

ft you need assistance m complying itia farm, caff i-8QO*PT&$199 a/K* select option Z 



PAGE 2/9* RCVD AT 1/17/2006 2:41:17 PM [Eastern Slandard Time] * SVR:USPTO-EFXRF-6/31 s DNIS:2738300 * CS©:3129021061 1 DURATION (mm-ss):03-02 



01-17-06 01 :45pm- F rora-KATTEN MUCH IN ROSENMAN 13129021061 



3129021061 



T-573 P. 03/09 F-220 



CENTRAL FAX eENTER 

JAN 1 7 2006 



PATENT 
ATTORNEY DOCKET 
NO. 2131 87-00002 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 
BEFORE TBfE BOARD OF PATENT APPEALS AND INTERFERENCES 



Applicantfs): Bates, et a}. 

Application No.: 09/679,391 

FileO: October 3, 2000 

For: Method and Apparatus for Associating the 
Color of an Object wiw an Event 

Group Art Unit: 2676 

Examiner: Blackman, Anthony J- 

CustoraerNo.: 27160 

Confirmation No.: 6681 

Mail Stop Appeal Brief-Patents 
Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 



CEffr^CATE of TfiApsMTSSIoq 

I hereby certify that ibis correspondence « being 
facsimile nansroineiJ (571) 273-8300) to ftc United 
States Patent and Trademark Office on.- 



Pate 




Nome of PersTO Signing CdHmcaw) 



REPLY TO EXAJ 



gR'S ANSWER Of NOVEMBER 16, 2005 



Sir: 

Pursuant to 37 CJF.R. §41.41, the Applicant hereby submits a reply to the Examiner's 
Answer within two months thereof. The Reply Brief does not include any new or non-admitted 
affidavit or other evidence. Accordingly, it is respectfully requested that the Reply Brief be 
entered- 

Claims 31-36 have been rejected under 35 U.S.C. § 102(e) as being anticipated by 
Rangan, et al, U.S. Patent No. 6,198,833. Claims 37 and 38 stand rejected under 3S U.S,C. § 
103(a) as being unpatentable over Rangan> et aL, in view of Issadore-Barreca, et al. 7 U.S. Patent 



1 
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No. 6,205,231 ("the Issadore-Barreca, el ai patent")- Each of These rejections are addressed 
below, 

CLAIM REJECTIONS - 35 U.S.C. ^ 102 
Claims 31-36 have been rejected under 35 \JSC § 102(e) as being anticipated by ibe 
Rangan, et al patent. It is bomboojc law that in order for there to be anticipation, each and every 
one of the elements of the claim must be contained in a single reference. If a single element is 
missing from the claim, there can be no anticipation. As will be discussed in more detail below, 
even though the method and system in both the Rangan, et al, patent and the claims at issue are 
directed to image processing and more particularly, identifying selected objects in a video frame 
to be automatically located in other video frames in a sequence of video frames, the technique 
used by the two systems differs drastically. In particular, there are many significant differences 
between the system disclosed in the Rangan, et al patent and the system recited in the claims at 
issue. First, the system recited in the claims at issue relates to determining a location in a video 
frames where an action by a pointing device has occurred defining a selected location. It is 
respectfully submitted that the Examiner has improperly used extrinsic evidence to define terms 
in the claim, contrary to the Court of Appeal and the Federal Circuit in Phillips v, AWH Corp.* 
363 FJd 1207 (Fed,Cir- 2004). Indeed, as set forth on page 13 of the Examiner's answer, the 
Examiner has relied on a definition from the Microsoft Press Computer Dictionary. 3rd Ed,, page 
20 to define the pointing device as recited in the claims at issue. As the Court of Appeal Federal 
Circuit has clearly pointed out, extrinsic evidence such as dictionary, are generally not 
peimissable for defining terms in a claim- Rather, the Court held that the patent specification as 
well as the file history are used to define the terms in a claim. As clearly set forth on page 14 of 
the specification, the pointing device recited in the claims clearly relates to a mouse and a mouse 
bunon ("According to the embodiments of the present invention, the user provides input on some 
area of a display device, for instance, by depressing a mouse button at a specified location- The 
invention then determines where the user has to press the mouse button and what color value 

i 
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appears on the display device at the time the user has depressed the mouse button/* page J4 ? 
lines 9-12). 

The tracking system disclosed in the Rangan, et al. patent is different. In this case, a 
tracking element 29 is selected and dragged over the object to be tracked, as illustrated in Fig- 3, 
below. 



as set forth in column 7, lines 7-13, et seq, of the Rangan, et al. patent: *To begin, an editor 
selects, typically by well-known cursor technique, a tracking element 29, a preselected shape and 
size, and place it (drag and drop), click on, etc. the selected element over an image entity to be 
tracked with the center point of the element substantially centered on the image entity to be 
tracked or at least on a portion of the entity." Thus, it should be clear that the Rangan, et al 
patent clearly does not determine a location in a video frame or an action by a pointing device 
(i.e., mouse) has occmred, defining a selected location. 

Claims 31 and 32 recite determining a color value for the selected location. Claims 33 
and 34 recite determining a color range for the selected object. 




3 
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The Rangan, et al. patent teaches utilizing a tracking element 29 and determines the 
signature of the pixels within the tracking element 29. The color signature relates to the location 
and value of the pixels, for example, the pixels 32 a-n in Fig. 3 above. The system then uses 
assumptions regarding the movement of the object to determine subsequent location of the 
object However, the color signature for the assumed locations and subsequent frames is verified 
("Typically, in a single frame, an entity, unless moving uncommonly rapidly, will not have 
moved far. A pattern of assumed center points in an expanding spiral around the original center 
point of the Tracking element is therefore assumed and the test pixel pattern at each assumed 
center point is taken and compared to the stored base signature. Thus, match to the stored 
signature is taken to be the new position of the image entity to be tracked " Rangan, et ai 
patent, column 9, lines 30-37). 

As such, it is respectfully submitted that the Rangan, et al patent clearly does not 
automatically associate an event with a color value associated with a selected location, as recited 
in claims 31 and 32 or a color range of a selected location as recited in claims 33 and 34- For all 
of the above reasons, it is clear that claims 31-36 recite elements clearly not disclosed or 
suggested by the Rangan, et ai patent. 

CLAIM REJECTIONS -3SILS.C. § 103 

Claims 37 and 38 have been rejected under U.S,C § 103(a) as being unpatentable over 
the Rangan, et al- patent, in view of the Issadore-Barreca, et al- patent. As stated in the 
Applicant's Appeal Brie£ it is respectfully submitted that the Examiner has failed to establish a 
prima facie case of obviousness as required by MPEP § 2143- In particular, in order to establish 
a prima facie case of obviousness, three criteria must be met- "First there must be some 
suggestion or motivation, either in the references themselves or in the knowledge generally 
available to one of ordinary skill in the art, to modify the reference or to combine reference 
teachings. Second, there must a reasonable expectation of success- Finally, the prior an 
reference (or reference when combined) must teach or suggest all the claim limitations. The 

4 
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teaching or suggestion to make the claim combination and the reasonable expectation of success 
must both be found in the prior art, not in the Applicant's disclosure/ 1 

It is respectfully submitted that the Examiner has failed to show a reasonable expectation 
of success. In particular, the Rangan, et al. patent relates to a method for tracking a selected 
object and video frame by acquiring the color signature of a region of interest bounded by the 
tracking element 29 (Fig. 3, Rangan, et al- patent). The Issadore-Bareeca, et al. patent, on the 
other hand, utilizes edge detection for tracking the edge of tags placed around an object of 
interest. Accordingly, it is respectfully submitted that the Examiner has failed to show that there 
is a reasonable expectation of success of the claim combination. 

Also, it is respectfully submitted that the specific combination being relied upon by the 
Examiner is not clearly defined. In particular, on page 9 of the Examiner's Answer, the 
Examiner states: "It would have been obvious to one skilled in the art at the time of the 
invention to use the * widely-practiced edge technique known as Sobers algorithm is used to 
detect an object 20. The edge is according to Gonzales and Woods, a boundary between two 
regions of an image ..." Issadore-Barreca, et at modifies "a method for tracking a moving entity 
in a video presentation ... of Bangan, et al- because both inventions share similar technological 
environments corresponding to the processing of moving images , . . and tracking moving entities 
in a video presentation." (Examiner's answer pages 9 and 10), 

Moreover, the Examiner has clearly failed to show that there was motivation to combine 
the teachings of the two patents. Jt appears that the Examiner is relying on statements on page 
20 of the Examiner's answer that the suggestion is "because both inventions share technological 
environment corresponding to the processing of moving video images," (Examiner's Answer, 
Page 20). The Examiner also states "In response to Applicant's arguments at the Examiner's 
conclusion of obviousness is based upon improper hindsight reasoning, it must be recognized 
that any judgment on obviousness is, in a sense, necessarily a reconstruction based on hindsight 
(Examiner's Answer, Pages 20 and 21). Based on the above, it is respectfully submitted that the 
Examiner has also failed to show that there was motivation to combine the references and has 

5 
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even admitted in his answer that the motivation was based on hindsight. For all of the above 
reasons, it is respectfully submitted die Examiner has failed to set forth a prima facie case of 
obviousness, 

OTHER ISSUES 

The Applicant would also like to address several points that appear on pages 13-21 of the 
Examiner's Answer. 

1. The Examiner is relying on Microsoft Press Computer Dictionary to support bis 
rejection- This dictionary is not of record- Moreover, as discussed above, the dictionary is 
improper for interpreting claims as set forth by the Court of Appeals for the Federal Circuit in 
Phillips, supra, Examiner's Answer page 13. 

2. The Examiner states in various locations that the Applicant has argued subject matter 
that is not recited in the claim. 

• Extremely computation - intensive arduous task invention of Rangan, et al (page 15) 

• Examiner's Answer, page 21, first Appellant, once again, argues subject matter that is not 
recited in the claim language by discussing an interactive t.v. 

Jt is respectfully submitted that the Examiner is improperly requiring all arguments 
regarding the benefits and limitations of the invention to be included in the claims. It is 
respectfully submitted that there is no such requirement for including benefits and limitations 
made in arguments to distinguish references in itoe claims. 

3. The Applicant also respectfully traverses the Examiner's statement that the arguments 
fail to comply with the 37 CFR UH(b) for failing to point out how the invention distinguishes 
from the references. As shown on page 16, the basis for this assertion appears to be that the 
Applicant has argued that the Rangan system is arduous and computationally intensive and that 
the Applicant has failed to replace the word ^comprising" with the word "consisting" as 
suggested by the Examiner. It is respectfully submitted that the Examiner's basis for suggesting 
that the Applicant has failed to comply with 37 CFR 1 41 1(b) are inappropriate. This argument 
is also repeated in the Examiner's Answer, page 1 8. 

6 
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4. Regarding the Examiner's Answer, page 22, the clear implication of the last paragraph 



of we Examiner's Answer is if we term "comprising" had been substituted in the claims with the 
word "consisting" wax all of the rejected claims would be allowed. It is respectfully submitted 
that such a statement clearly undermines the Examiner's position on the rejections set forth 
above. For all of the above reasons, the Board is respectfully requested to reverse the 
Examiner's rejection of we claims. 



FATTEN MUCHDSf ROSENMAN LLP 
525 West Monroe Street 
Chicago, Dlinois 60661-3693 
Tel: (312)902-5200 
Fax: (312) 902-1061 



Respectfully submitted, 

KATTEN MUCHJN ROSENMAN LLP 
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